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CLAIMS 

We claim: 

1. A system for content adaptive encoding of video comprising: 

an extractor that divides the video content into temporal portions; 

a locator that associates descriptors to each portion based on portion content; 

a mapper that maps each portion of the video content to a model from a plurality 
of models based on the portion descriptors; and 

a plurality of encoders, each encoder of the plurality of encoders configured to 
encode portions according to the model associated with the portion. 

2. The system of claim 1, further comprising: 

a generic encoder included in the plurality of encoders, wherein portions not 
associated with any model from the plurality of models are encoded using the generic 
encoder. 

3. The system of claim 1, wherein the locator further locates subsegments. 

4. The system of claim 3, wherein the locator further locates regions of interest. 

5. The system of claim 4, wherein the mapper further comprises: 

a plurality of content model units, each content model unit of the plurality of 
content model units being associated with a model of the plurality of models; 

a plurality of comparators, each comparator of the pliirality of comparators 
connected to a content model unit and an output from the extractor or an output from 
the locator; and 

a plurality of selectors, wherein each selector of the plurality of selectors is 
connected to two of the comparators. 

6. The system of claim 5, wherein the plurality of content model units further 
comprises a generic content model unit. 
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7. The system of claim 6, wherein the mapper outputs from the selectors a signal 
that controls a switch to route portions to one of the plurality of encoders. 

8. A system for content adaptive encoding of video comprising: 
an extractor that divides the video into temporal portions; 

a locator that associates descriptors with each portion based on portion content; 

a mapper that maps each portion of the video to a model chosen from a plurality 
of models based on a comparison of the plurality of models to the descriptors associated 
with each portion; 

a buffer for storing the portions, the buffer having outputs connected to a 
switch; and 

a plurality of encoders, each encoder of the plurality of encoders connected to 
the output of the switch and configured to encode segments according to the model 
associated with the portion. 

9. The system of claim 8, further comprising: 

a generic encoder included in the plurality of encoders, the generic encoder 
encoding portions not having an associated model. 

10. A video extraaor used for content adaptive encoding of video, the video 
extractor comprising: 

a video segment extractor receiving the video; 

a plurality of characteristic extractors each receiving the video and outputting a 
signal associated with an attribute of the video to an analyzer, the analyzer determining a 
characteristic of the video; 

a manual segment extraction module receiving the video and an output from the 
analyzer, wherein the manual segment extraction module provides an output signal 
associated with the video divided into temporal segments; 

a plurality of memory units for storing segments; and 
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a switch for routing video segments into the plurality of memory units for storing 
segments. 

11. The video extractor of claim 10, further comprising: 

a header extractor for extracting header information from video. 

12. The video extractor of claim 11, further comprising: 

an interpreter receiving output from the analyzer for automatically determining 
video segments. 

13. The video extractor of claim 12, further comprising: 

a switch cormected to an output from the interpreter and the manual video 
content extractor module, wherein manual or automatic segment extraction may be 
output. 

14. The video extractor of claim 10, wherein the plurality of characteristic video 
content extractors comprises a shot concept extractor, a scene properties extractor, a 
camera operation extractor, a special effects extractor and a textual transcript keyword 
extractor. 

15. The video extractor of claim 14, wherein the analyzer performs semantic and* 
statistical analysis on the video. 

16. A video segment extractor comprising: 

a human operated module for determining video segments from input video; 

an automatic video segment determining module for automatically determining 
video segments having an output connected to the human operated module; and 

a switch for choosing output from either the hviman operated module or the 
automatic video segment determining module. 

17. The video segment extractor of claim 16, further comprising: 

a segment extractor connected to a second switch which routes video segments 
to one of a plurality of storage units. 
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18. The video segment extractor of claim 17, wherein the automatic video segment 
determining module further comprises a plurality of characteristic extractors each 
receiving the video and outputting a signal associated with an attribute of the video. 

19. The video segment extractor of claim 18, wherein the automatic video segment 
determining module further comprises an analyzer, the analyzer receiving input from 
each of the plurality of characteristic extractors, and the analyzer further outputting a 
signal to the human operated module. 

20. The video segment extractor of claim 19, wherein the human operated module 
optionally provides the output of the analyzer to a human operator for assigning video 
segments. 

21. A video content locator for locating subsegments and regions of interest, the 
locator comprising: 

a video subsegment locator; 

a plurality of characteristic circuits each receiving the video content and each 
producing a characteristic output; 

a manual location module receiving the video content and the characteristic 
output from each of the plxirality of characteristic circuits, wherein subsegments and 
regions of interest are determined using the manual location modvile which produces a 
control signal, wherein the control signal controls the subsegment locator. 

22. The video content locator of claim 21, wherein the manual location module uses 
the output from the plurality of characteristic circuits to determine subsegments and 
regions of interest. 

23. The video content locator of claim 22, further comprising: 

an analyzer connected to outputs of each of the plurality of characteristic circuits, 
the analyzer outputting a signal associated with a statistical analysis of the video content 
to an interpreter and to the manual location module; and 
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a switch for switching between the statistical analysis signal from the analyzer and 
a signal output from the manual location module. 

24. The video content locator of claim 23, further comprising: 

a plurality of region of interest locators each receiving via a switch an output 
signal from the subsegments locator; and 

a plurality of subsegment and region of interest index storage units each receiving 
an output from one of the plvirality of region of interest locators. 

25. A video content locator for locating subsegments and regions of interest in multi- 
media content, the video content locator comprising: 

a video subsegment locator having an output signal; 

an automatic analyzer for receiving video content and automatically making 
characteristic determinations and subsegment divisions; 

a manual operation module for manually making subsegment divisions, the 
output signal from the automatic analyzer being input to the manual operation module; 

a plurality of region of interest locators connected to the output signal of the 
video subsegment locator; and 

a plurality of subsegment and region of interest storage units, each imit 
connected to an output of one of the region of plurality of interest locators, wherein a 
control signal from the manual operation module controls the routing of the output of 
the video subsegment locator to each of the plurality of region of interest locators. 

26. A system for mapping video content models to video segments, the system 
comprising: 

a first video content descriptor storage unit; 
a second video content descriptor storage unit; 
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a first comparator that receives an output from the first video content descriptor 
storage unit and receives a video segment, the comparator producing a first comparator 
output signal; 

a second comparator that receives output from the second video content 
descriptor storage unit and receives a video segment, the comparator producing a second 
comparator output signal; and 

a selector that receives the first comparator output signal and the second 
comparator output signals and produces a selector output signal representing a video 
content segment associated with a model. 

27. The system of claim 26, further comprising a buffer for storing the selector 
output signal until the selector output signal is ready to be encoded. 

28. An apparatus for encoding video content divided into segments, the apparatus 
comprising: 

a switch having an input receiving the video content and a plurality of outputs; 

and 

a plurality of encoders, each encoder of the plurality of encoders being connected 
to an output of the plurality of switch outputs. 

29. The apparatus of claim 28, wherein the switch is controlled to route each 
segment to one of the plurality of segments based on a segment model. 

30. The apparatus of claim 29, wherein each encoder of the plurality of encoders is 
associated with a predetermined model. 

31. The apparatus of claim 30, wherein an encoder of the plurality of encoders is a 
generic encoder for encoding segments not associated with a predetermined model. 

32. An apparatus for encoding video content divided into portions, the apparatus 
comprising: 
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a switch having an input receiving the video content and a plurality of switch 
outputs; and 

a plurality of encoders, each encoder of the plurality of encoders being connected 
to an output of the plurality of switch outputs, wherein each portion of video content is 
routed to one of the plurality of encoders based on a content model associated with each 
portion. 

33. The apparatus of claim 32, wherein the portions of the video content are 
segments. 

34. The apparatus of claim 32, wherein the portions of the video content are regions 
of interest. 

35. The apparatus of claim 32, wherein the portions of the video content are 
subsegments. 

36. An apparatus for encoding video content, the video content divided into portions 
with each portion associated with a content model, the apparatus comprising: 

a generic encoder associated with a generic content model; 

a plurality of encoders, each encoder of the plurality of encoders being associated 
with a content model; and 

a switch for routing the video content portions to either the generic encoder or 
one of the plurality of encoders based on the model associated with each video content 
portion. 

37. The apparatus of claim 36, wherein the portions of the video content are 
segments. 

38. The apparatus of claim 36, wherein the portions of the video content are regions 
of interest. 

39. The apparatus of claim 36, wherein the portions of the video content are 
subsegments. 
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